D-A032  690 


unclassified 


NORTH  CAROLINA  UNIV  AT  CHAPEL  HILL  DEPT  OF  STATISTICS  F/G  12/1 

ON  THE  EXPONENTIAL  BOUNDEDNESS  OF  STOPPING  times  OF  INVARIANT  S— ETC (U) 
JUL  76  H ROOTZENf  G SIMONS  N00014-75-C-0p09 

MIMEO  SER-1076  NL 


I OF  I 

AQAO  3.-  690 


ADA082690 


On  the  Exponential  Sountiedness  of  Stopping  Tines  of  Invariant  SPRT's 


by 

: toller  Footzdrf 

Department  of  Mathematical  Statistics 
University  of  Lund 
and 

Department  of  Statistics 
University  of  North  Carolina  at  Chapel  Hill 


and 


Gordon  Sinons 

Department  of  Statistics 
University  of  North  Carolina  at  Chapel  Hill 


Institute  of  Statistics  Ilineo  Series  #1076 


o^\ 


July,  1975 


copy  mmi  to  d :c  coiis  r 

f!  II  1 V I t- I f - - 

ulL  i . . . 


.irir.  v 

1 1 a i 


1 Research  snonsored  in  part  by  the  Office  of  daval  Research  under  Contract 
H00014-75-C-0309. 

2 

Research  supported  by  tiie  national  Science  Foundation  under  Contract 
MPS75- 07556. 


i 


UNCLASSIFIED 

SECURITY  CL  AMI  FI  CATION  OF  THI»  PAPE  |TF><«n  Dote  Untotod) 

[ REPORT  DOCUMENTATION  PAGE 


lx.  30VT  ACCESSION  NO.I 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 
RECIPIENT'S  CATALOO  NUMBER 


4..-HTLE  (end  Subtitle) 

L On  the  Exponential  Boundedness  of 
'~y\  Stopping  Times  of  Invariant  SPRT's, 


7 A^ThORC.J 

• Holger/Rootzen  9 Gordon /Simons 
/ / m / 


type  of  report  s period  covered 


[ECHNICAL 


/ , . S.  ejERFORMIBfi  ORB,.  REPORT  NUMBER 

jj/f  Mimeo  Serimatsil^.— 1076  / 
N000l4-75-Cji8d9  j 


» PCRFORMINO  OROANIXATION  NAME  AMO  ADDRESS 

Department  of  Statistics 
University  of  North  Carolina  ^ 

Chapel  Hill,  North  Carolina  27514 

II.  CONTROL  LINO  OFFICE  NAME  AND  ADORES* 

Statistics  5 Probability  Program 

Office  of  Naval  Research,  Attn:  Dr.  McDonald 

Arlington.  Virginia  22217 

n SoSiTomia  aoency  name  t AODRCssfi/  mSmm  *m>  Contratunt  i 


10.  PROCRAM  ELEMENT.  PROJECT.  TASK 
AREA  * WORK  UNIT  NUMBERS 


IX.  REPORT  DATE 

' Jul«sM76  ] ^ 

IX.  NUMBER  OF  PAPES 

7 

IS.  SECURITY  CLASS,  (el  Ihle  report) 

UNCLASSIFIED 


1S«.  OECLASSIFICATION/DOWNORADING 
SCHEDULE 


| IS.  DISTRIBUTION  STATEMENT  (el  thle  Hoport) 


Approved  for  Public  Release:  Distribution  Unlimited 


[ 17.  DISTRIBUTION  STATEMENT  (ol  the  mbetroct  entered  In  Block  20,  II  dHlerent  hem  Report) 


[19.  supplementary  NOTES 


If.  KEY  WORD*  (Continue  on  reeeree  oldo  II  nooooomr  md  Identity  by  block  number) 

Invariance,  sequential  probability  ratio  test,  exponential  boundedness, 
likelihood  ratio,  stopping  time 

SOI  ABSTRACT  (Continue  on  reeeeee  oldo  II  neeeeeeer  end  Identity  S r Meek  member) 

/It  is  shown,  under  conditions  which  include  invariant  sequential  probability 
ratio  tests,  that  the  stopping  time  is  always  exponentially  bounded  when  the 
null  or  alternative  hypothesis  holds,  except  in  a trivial  instance. 


DO  t j°N *7,  1473  EDITION  OF  1 NOV  #•  IS  OBBOLBTE 


UNCLASSIFIED  : -j 

SECURITY  CLASSIFICATION  OF  THlf  P ABE  fBI 


On  the  Exponential  Boundedness  of  Stopping  Times  of  Invariant  SPRT's 


Short  Title:  Lxponential  Boundedness  of  Stopping  Tines 

by 

Holger  Rootz&i1  University  of  Lund  and  University  of  Worth  Carolina 

Gordon  Sircons2  University  of  Worth  Carolina 

Abstract.  It  is  shown,  valuer  conditions  which  include  invariant  sequential 
probability  ratio  tests,  that  the  stopping  tine  is  always 
exponentially  bounded  when  the  null  or  alternative  hypotljes^ 
holds,  except  in  a trivial  instance.  / 


X 


AHS  Classification:  Primary  62L10 

Secondary  60G17,  60G40 


Key  'Words  and  Phrases:  Invariance,  sequential  probability  ratio  test,  \ y / 

exponential  boundedness,  livelihood  ratio, stopping 
tirae 


1 Research  sponsored  in  part  by  the  Office  of  flaval  Research  under  Contract 
W00014- 7 5-C- 0309 . 

2 Research  supported  by  the  Wational  Science  Foundation  under  Contract 
MPS75-07556." 


1 


This  paper  is  primarily  concerned  with  showing  tiiat , for  invariant 
sequential  probability  ratio  tests,  the  stopping  time  is  exponentially 
bounded  under  the  null  and  alternative  hypotheses,  with  the  exception 
of  trivial  situations.  This  work  is  the  by-product  of  a largely  unsuccessful 
attempt  to  obtain  general  results  under  non-model  distributions.  Since 
v/e  view  the  lack  of  these  general  results  as  a major  deficiency  in  the 
theory  of  sequential  analysis,  we  shall  suggest  what  we  believe  are  reasonable 
conjectures  and  shall  discuss  some  of  the  past  literature  on  the  subject. 

Let  (Q , 8)  be  a measurable  space  and  {8n,  n>l}  be  a nondecreasing 

3 

sequence  of  sob-o- fields  of  3.  A stopping  time  N adapted  to  {E>n,  n>l) 
is  said  to  be  exponentially  bounded  for  a family  of  probability  measures 
R on  (fi,3)  if  for  each  probability  measure  R e R there  exist  constants 
c > 0 and  p < 1 such  tliat  R(N>n)  < cpn  , n = 1,2,...  . Such  a condition 
implies  that  H is  finite  a.s.  (R)  and  that  M has  a moment  generating 
function  in  some  neighbor! rood  of  the  origin  for  each  R e R. 

Let  P and  Q be  elements  in  R and  let  Ln  denote  the  P - Q 

A 

likelihood  ratio  for  3 . Sequential  probability  ratio  tests  are  defined 

Ln  terms  of  a stopping  variable  d of  the  general  form 


Here,  il  is  said  to  be  adapted  to  {3  , n>l}  if  [N  = 1,2,...  or  »]  = Q 
and  [H=n]  e Bn  for  n = 1 , 2 , . . . . 

4 For  a precise  definition  of  this  concept  see  Eisenberg,  Ghosh  and 
Simons  (1976) . Essentially,  L is  the  Radon-Uilcodyn  derivative 
dQ/dP  relative  to  15  . 
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r 


li 


N 


(1)  N = the  first  n £ 1 such  that  L 4 (A,B) 

XI 

= oo  if  no  such  n exists, 

where  0 < A < 3 < °°.  At  this  level  of  generality,  it  is  easy  to  construct 
examples  for  which  N is  exponentially  bounded  for  {P,Q}  and  others 
for  which  it  is  not.  All  that  is  known,  in  general,  is  derived  fror/i 
the  following  set  of  inequalities,  described  by  Eisenberg,  Ghosh  and 
Simons  (1976) : 

AP(N>n)  !£  0(N>n)  < 3P(i'!>n),  n = 1,2,...  . 

It  follows  immediately  that 

(a)  P(N«»)  = 1 iff  Q(M<oo)  = 1, 

(b)  for  each  r > 0,  j HrdP  < °°  iff  j NrdQ  < °o,  and 

(c)  N is  exponentially  bounded  for  {?}  iff  it  is  exponentially 
bounded  for  {Q}. 


Now  suppose  X,,A2,...  is  a sequence  of  random  elements  on  (fi,8) 

(to  the  statistician,  ‘’potential  data1)  and  Bn  = o^,...,^)  (the 
a-field  generated  by  ).  If  is  an  i.i.d.  sequence 

under  P and  Q,  then  (log  1^,  n>l)  is  a random  walk  under  both  P 
and  Q.  It  follows  that  N is  exponentially  bounded  for  {P,Q>  unless 
= 1 a.s.  (P,Q).  This  is  a well-known  result  due  to  Stein  (1946). 

We  shall  now  describe  a similar  result  for  invariant  sequential  probability 


ratio  tests. 

Consider  the  following  mathematical  structure: 


.T.-vr 
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(i)  P and  0 are  two  disjoint  families  of  probability  measures 
on  (Q , 8) . 

(ii)  '^1  * ^2 ' ‘ ‘ 311  sequence  of  random  elements  for  each 

probability  neasure  Re  P u Q. 

(iii)  For  each  n > 1,  &n  = c(T^)  where  Tn  is  a statistic  which 

is  a symmetric  function  of  . 

(iv)  For  each  n > 1,  is  on-neasurable  for  k = l,2,...,n. 

( I • e • j 8-^  c 82  ^ • » « t ) 

(v)  For  each  n > 1,  the  probability  space  0?,bn>R)  is  the 
same  for  every  R e ?,  and  is  the  same  for  every  R e £. 

This  is  the  structure  tliat  one  encounters  when  invariant  sequential  proba- 
bility ratio  tests  are  being  considered.  If  one  wishes  to  test  the  (conpo- 
site)  hypothesis  that  the  true  probability  neasure  R belongs  to  P 
against  the  (composite)  alternative  that  it  belongs  to  h,  the  following 
sequential  probability  ratio  test  suggests  itself:  Let  P e P and 

Q e Q.  be  chosen  in  an  arbitrary  nanner,  and  let  Ln  be  the  P - Q 
likelihood  ratio  for  Bn  (n  > 1) . Because  of  property  (v),  each  possible 
pair  (?,Q)  leads  to  the  sane  sequence  of  likelihood  ratios  LpL2>...  . 
Let  N be  the  stopping  variable  described  in  (1)  and  choose  P or  J 
according  as  W < °°  and  L,j  s A or  N < 00  and  a B,  respectively. 

(If  N = 00,  no  decision  is  made.)  We  have  the  following  theorem: 


THEfiRB  i Eitlier  Ln  = 1 a.s.  (P  u Q)  for  n 5:  1,  or  N is  exponentially 
bounded  for  P u Q.. 
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PRCCr  In  view  of  (c)  and  (v) , N is  exponentially  bounded  for  P u & 

iff  it  is  exponentially  bounded  for  {P}.  Likewise,  Ln  = 1 a.s.  (P  u Q) 

for  n > 1 iff  PQL^  = 1)  = 1 for  n > 1.  Suppose  the  latter  is  false, 

i.e.,  that  for  some  k,  P(Lj,  =1)  <1.  For  simplicity,  we  shall  assume 

that  k can  be  taken  to  be  unity.  If  a larger  value  of  k is  required, 

the  proof  we  shall  give  that  N is  exponentially  bounded  for  {P}  can 

be  easily  modified.  Express  as  t(X^)  and  as  £(X^)  and 

observe  that  EL^  < 1 and  (since  P(Lj=l)  < 1 ) that  E log  < 0. 

Set  3^  = d(t(X^),  ...  ,t(X.))  and  observe  that  is 

the  P - Q likelihood  ratio  for  8^  in  view  of  condition  (ii)  (n  > 1). 

ibreover,  conditions  (iii)  and  (iv)  irmly  that  8’  c 8_  and,  hence, 

6n  5 n n 

2 1 ^0T  r ~ for  p < 1,  to  be  chosen  later. 


8’  8’  i 

P n(L  > A,  LI  s pn)  s A_1I  , E \ 5 A p 
n " [I.^pn]  " 


and,  hence. 


pr 


8! 

n, 


CJ>n)  < P(Ln>A)  = EP  JI(Ln>A) 
s A_1pn  + ?(L^  > pn). 


Thus  it  suffices  to  show,  for  properly  chosen  p < 1 and  p'  < 1,  that 


P(L^  > pn)  ^ (p')n  . 

Since  EL^  s 1,  ECLj)^  ^ 1 for  0 < t < 1.  In  fact,  if  p is  chosen 
so  that  2 log  < log  p < 0,  then  there  exists  a small  positive  tQ 

such  that 

5 

Equality  holds  if  P and  0 are  equivalent  probability  measures  on  Sn 
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Then 


t0(los  L,  - log  p) 

)'  = 5 e < 1. 


p(l;  > Pn)  = p(_n  KXj)  > Pn) 

-ntn  n tn 

s p u E[  n «,(X.)1  U 
i=l 

- „'nt0  Pnn  /0  , Mn 

= p E (L^)  = (p  ) 


□ 


V-fe  should  point  out  that  it  is  always  possible  that  Ln  = 1 a.s. 

(P  u 0 for  n 2:  1.  (This  is  the  case,  for  instance,  if  T 2 1 for 
n > 1 .)  however,  this  possibility  does  not  detract  from  the  strength 
of  the  theorem.  Tor  if  Ln  = 1 a.s.  (P  u 0)  for  n s 1,  then,  for 
each  n > ls  the  probability  spaces  (ft,Bn,R),  Re  P u 0V  are  all  the 
sane  and  there  is  no  information  available  for  distinguishing  between 
the  two  families  P and  0.  In  practice,  one  would  never  consider  pro- 
posing such  a test. 

A close  examination  of  our  proof  reveals  that  conditions  (ii)  and 
(iii)  are  stronger  than  necessary,  lie  shall  not  try  to  state  the  weakest 
possible  conditions,  but  simply  make  the  observation  that  the  argument 
works  because  the  a- fields  Sn  , n e 1,  grow  at  a sufficiently  fast 
rate  aider  conditions  (ii)  and  (iii).  Note  also  that  the  proof  shows 
exponential  boundedness  .aider  P for  the  'single  boundary”  stopping 
time 

N*  = the  first  n > 1 such  that  Ln  > A, 

= ® if  no  such  n exists. 


It  is  reasonable  to  ask  whether  our  theorem  has  an  extension  to 
probability  measure  R ( P u 0 under  which  X.  ,7^, . . . is  an  i.i.d. 
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sequence.  It  is  possible  to  extend  it  to  other  probability  measures 
within  a monotone  likelihood  ratio  class  (cf . } A.  If  ram  (1965)) 
but  this  amounts  to  a very  restrictive  improvement.  R.  Wijsman  (1970) 
has  found  an  interesting  example  for  which  R(N<°°)  = 1 but  N is  not 
exponentially  bounded  under  k.  This  would  seem  to  put  to  rest  any  hope 
of  finding  a general  extension  of  our  theorem  However,  it  must  be  remembered 
that  a P - Q likelihood  ratio  is  uniquely  defined  only  up  to  a P and  0 
equivalence,  and,  in  Hijsnan's  example,  the  probability  measure  R is 
orthogonal  to  the  probability  measures  in  Pub  on  the  a- fields  8 . 

Indeed  there  exist  other  versions  of  the  likelihood  ratios  , appropriate 
to  his  example  (albeit  less  natural  from  a topological  viewpoint) , for 
which  N is  exponentially  bounded  under  R.  Recently,  Wijsman  (1976a) 
has  been  working  with  some  examples  for  which  R is  dominated  (on  each 
8n  ) by  the  probability  measures  in  P u Q..  (In  such  a case,  the  likelihood 
ratios  Ln  are  uniquely  specified  up  to  ail  R- equivalence.)  For  these, 
again,  R(H«»)  - 1 but  N is  not  exponentially  bounded  under  R.  Me 
believe  it  is  significant  that  the  probability  measures  R,  in  his  examples, 
are  not  equivalent  to  the  probability  measures  in  P u Q_  (on  each  Bn  ) . 

For  one  thing,  there  exist  examples,  within  the  context  of  conditions 
(i)  - (v) , for  which  R is  dominated  by  but  is  not  equivalent  to  the 
probability  measures  in  P u 2,  with  the  property  that  R(N=°°)  = 1,  and 
yet  the  condition  " R(Ln=l)  = 1 for  n > 1 " does  not  hold.  However,  on 
the  basis  of  our  studies,  we  are  prepared  to  conjecture  tliat  R(N<°°)  = 1, 
whenever  R and  the  probability  measures  in  P u Q.  are  equivalent  on 
a(X^)  and  the  probability  spaces  (ft,Bn,P)  and  (fI,8n,Q)  are  distinct 
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for  some  n 2 1,  P e P,  Q e <£.  Indeed  we  suspect  that  these  conditions 
guarantee  that  N is  exponentially  bounded  under  R.  Here,  we  are  assuming 
the  structure  imposed  by  conditions  (i)  - (v). 

We  do  not  want  to  leave  the  reader  with  the  impression  that  there 
are  no  results  of  a general  nature  concerning  R 4 P u ().  R.  Berk  (1970) 
lias  obtained  results  for  what  he  calls  parametric  sequential  probability 
ratio  tests  and  R.  Wijsman  (1976b)  has  recently  obtained  a theorem  concerned 
with  exponential  boundedness.  Their  results  exploit  the  fact  that,  in 
many  useful  examples  of  invariant  sequential  probability  ratio  tests, 
the  log- likelihood  ratios  (log  L^,  n>l}  become  a random  walk  asymptotically 
(under  R ) as  n This  is  not  always  the  case.  (There  are  practical 

examples  to  the  contrary.)  Therefore,  it  appears  that  some  substantially 
new  approaches  are  called  for. 
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